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Noise aids the encoding of continuous signals into pulse 
sequences by way of stochastic resonance and endows the en- 
coding device with a preferred frequency. We study encoding 
by a threshold device based on the Ornstein-Uhlenbeck pro- 
cess, equivalent to the leaky integrate-and-fire neuron model. 
Preferred frequency, optimum noise intensity, and optimum 
signal-to-noise ratio are shown to be linearly related to the 
AC amplitude of the input signal. The DC component of the 
input tunes the device either into transmission (preferred fre- 
quency nearly independent of signal amplitude) or selection 
mode (frequency rising with amplitude). We argue that this 
behavior may facilitate selective signal processing in neurons. 



I. INTRODUCTION 

Our view of noise has shifted markedly over the past 
two decades: After it had long been seen merely as a 
nuisance, geophysicists first suggested in 1981 that noise 
may amplify the effect of weak periodic signals on dy- 
namic systems 0. This effect, called stochastic reso- 
nance (SR), has since been found in a variety of exper- 
iments. The origin of stochastic resonance in both dy- 
namical and non-dynamical systems is well understood 
today, although theories are mostly confined to slow sig- 
nals. A recent review of the field can be found in Ref. . 

The finding that noise may aid signal detection and 
transmission has spurred intense research in the neuro- 
sciences, where scientists have long been puzzled by the 
seeming irregularity of neuronal activity. The benefits 
of noise for signal processing in neurons have now been 
demonstrated in a wide range of species: neurons trans- 
duce a signal (or stimulus) optimally if a certain amount 
of ambient noise is present H ; see Ref. [Q for a review. 

Recent studies by ourselves [|| and other authors ||] 
have revealed a further noise-induced resonance effect 
in model neurons: There is also an optimum signal fre- 
quency, for which the neuron responds with spike trains 
(output signals) that have a particularly high signal-to- 
noise ratio (SNR). In this letter, we show that this res- 
onance frequency and the optimum noise amplitude are 
linearly related to the AC component of the signal im- 
pinging on a neuron, while the DC component serves as 
tuning parameter. We argue that these relations permit 
the neuron to switch between a signal transmission and 
a signal selection mode of operation. 



The present work is based on the integrate-and-firc 
neuron model, which will briefly be reviewed in Sec. ||, 
before the noise-induced response properties of the neu- 
ron are presented in Sec. III. Implications for neuronal 
signal processing are discussed in Sec. IV. More details 
are contained in Ref. [ml. 



II. MODEL 

We focus on the spike generator of neurons for the 
sake of both simplicity and generality. The spike gener- 
ator integrates the net input current I(t) impinging on 
the neuron like a leaky capacitor. For sinusoidal input 
superimposed with white noise, the potential v(t) across 
the capacitor (the membrane potential) is thus governed 

by [I 



v{t) = -v(t) + H + qcos(nt + <j))+ cr£(t). 



(1) 



The input is characterized by the DC offset /i, the sig- 
nal amplitude q, the frequency f2, and the (arbitrary) 
initial phase ip. The noise term with root mean square 
amplitude a and autocorrelation (£(£)£(£')) = 8(t — t') 
subsumes the noise arising both from cell biochemistry 
[ 3] and background activity in the neuronal network 
[lQfl. The neuron emits a stereotyped voltage pulse (a 
spike) whenever the membrane potential reaches a fir- 
ing threshold v(tk) = 1 = S; the potential is reset to 
v(tfc) = v r < 1 immediately thereafter. Time and volt- 
age are measured in their natural units, i.e., the mem- 
brane time constant r m and the firing threshold O. 

The spike generator thus operates as an analog-to- 
digital converter [pd|] , encoding the continuous input sig- 
nal I(t) into a pulse train /(i) = J2k$(t ~ ^fc)- Even 
though this model is a gross simplification of biological 
neurons, it has proven most fruitful for investigations of 
the nature of the neuronal code JlJ,[l3| . For a derivation 
of this model from more realistic neuron models, see [H . 

We restrict ourselves to sub-threshold signals, which 
would not elicit any spikes in the absence of noise, i.e., 
maxt^oo v(t) = fi + + ^ 2 < 1 from integration of 

Eq. ([!]). These appear to be more relevant than super- 
threshold signals for the encoding of periodic signals [jl5| . 
Note that the membrane potential will oscillate about 
v = [i after an initial transient in the absence of noise. 

We measure the performance of the neuron in coding 
the sinusoidal input by the signal-to-noise ratio 
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i? S N = S(Q)/S F 



(2) 



of the output spike train at the signal frequency. Here, 
— J T ° f(t)e tnt dt\ 2 is the power spectral den- 
sity of the train for a given observation time T a , while the 
white power spectrum of a Poissonian spike train with 
equal mean interspike interval (r), i.e., Sp = (7r(r)) _1 , 
is used as reference noise level. T a = 200 is employed 
throughout §,pl. 



III. RESPONSE PROPERTIES 

The leaky integrate-and-fire neuron responds best to 
sinusoidal stimulation — i.e. attains a maximum signal- 
to-noise ratio — at a particular combination of signal fre- 
quency Q and input noise amplitude a, see Fig. [[J The 
location of the SNR maximum is marked by an aster- 
isk Jl6|]. In what follows, we shall explore the location 
of and the SNR value at this maximum as a function 
of the remaining stimulus parameters, namely the signal 
amplitude q, the DC offset /x, and the reset potential v r . 

In the absence of noise, sub-threshold stimuli evoke 
membrane potential oscillations about v = fi as pointed 
out in Sec. |l[ The gap between this average potential 
and the threshold, O — v = 1 — //, needs to be bridged 
by the concerted effort of signal-induced oscillations and 
noise. It is therefore plausible to scale both stimulus and 
noise amplitude by this threshold distance, i.e., to define 
relative amplitudes, 
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Furthermore, the reset potential v r should enter only 
as the ratio of the reset distance to threshold distance, 
which we shall refer to as relative reset 
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(4) 



This scaling can be established rigorously via escape 
noise approximations to the dynamics of the integrate- 
and-fire neuron [0^]. 

We shall now turn to the relation of the optimum tun- 
ing parameters (preferred signal frequency f7 opt , scaled 
noise amplitude c° pt , and SNR i?g^) to the signal am- 
plitude parameters (scaled AC amplitude q ri and relative 
reset 7; or DC offset /i and reset potential v r instead of 
7). Figure ^(a) indicates a perfect linear relation between 
-RgN* , the attainable SNR, and the stimulus amplitude gy, 
while the optimum input noise amplitude er° pt s» 0.6 — 0.7 
is practically independent of q r , see Fig. ^(b): variations 
of <7° pt are about one order of magnitude smaller than 
the range of q r values. Both relations are remarkably in- 
dependent of the value of the DC offset /j, (indicated by 
symbol/line type in Fig. H, supporting the scaling given 

are thus independent of the 



DC component of the signal transmitted for fixed reset 
potential. 

A different behavior is observed for the optimum fre- 
quency n° pt as shown in Fig. ||(a): For large values of 7, 
i.e., a strong positive DC offset, the optimum frequency 
is nearly independent of the signal amplitude q r , while 
small values of 7 lead to a marked linear dependence of 
Qopt Qn q^. tne p re f errec i frequency may be selected by a 
variation of the signal amplitude. Figure ||(a) also clearly 
indicates that the response of the neuron depends on the 
DC offset fj, and reset potential v r only via the relative 
reset 7, vindicating Eq. (Q): each data point shown is 
a superposition of two almost perfectly coincident points 
obtained from different (/1, ty)-combinations yielding the 
same 7 (circles, crosses). The same is found for and 
a° pt (not shown). The results presented here are thus 
applicable both to sensory and cortical neurons: the for- 
mer are best fit by the model for reset potentials v r as 
0, while the latter require v r as 0.7 fll3| . 

Figure ||(a) indicates that the integrate-and-fire neu- 
ron may operate in two different modes: a transmission 
mode for large 7, which optimally encodes stimuli of a 
fixed preferred frequency Q° pt as 1 irrespective of their 
amplitude, and a selection mode, in which the preferred 
frequency may be chosen by variation of the stimulus am- 
plitude q r . The slope of the frequency-amplitude curve 
(linear least squares fit) as a function of the relative reset 
7 is shown in Fig. ^(b). There is a sharp transition be- 
tween the selection and transmission modes at 7 as 2.1. 
No slope could be determined for 7 < 1.5, since the pe- 
riod of the optimal stimulus 27r/f2 opt tends to the dura- 
tion of the observation period T Q for small amplitudes q r 
in this case. 

The two modes of operation arise through different fir- 
ing patterns: For large relative reset (7 > 2), less than 
one spike is fired on average per stimulus period, i.e., the 
neuron fires at most one well phase-locked spike per pe- 
riod, and often skips periods in between spikes, with a 
slight increase in spike number with q r . For small reset 
(7 < 2), in contrast, the neuron has a bursting firing 
pattern for small q ri i.e., two or three spikes are fired in 
rapid succession near the maximum of the signal in each 
period, followed by silence till the next period. As q r 
is increased and the optimum frequency rises, the signal 
period becomes too short to harbor more than one spike 
and bursting gives way to a more regular firing pattern, 
with a little more than one spike per period on aver- 
age. For intermediate reset (7 as 2), the neuron fires 
almost regularly, with about 0.8 spikes per signal period 
independent of q r . Cold receptor neurons show all three 
kinds of firing patterns (skipping, regular, bursting) de- 
pending on ambient temperature |18|; their behavior is 
reproduced well by the integrate-and-fire neuron fij . 



in Eq. (§. 
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IV. FUNCTIONAL SIGNIFICANCE 

Let us summarize the neuronal response properties and 
discuss them in turn: (i) The optimal signal-to-noise ratio 
scales linearly with the input signal amplitude, and (ii) is 
attained at a constant noise amplitude, while (iii) the 
preferred frequency is either independent of (transmis- 
sion mode) or linearly related to the signal amplitude 
(selection mode). 

Property (i) means that the optimal SNR of the spike 
train emitted by the neuron is related to the SNR of 
the input signal as -RgjJ ~ q r ~ \/-^SN (01 > m c L uau ta- 
tive agreement with recent findings in a variant model 



neuron |20|. This suggests a law of diminishing returns 
for the signal-to-noise ratio: there is no point in invest- 
ing valuable resources to improve R™ N beyond a certain 
level, because resulting gains in Rg^ would be minimal. 
Since the output of each neuron in turn is input to other 
neurons, the same argument holds for raising The 
level of noise observed in the brain might thus reflect 
an evolutionary compromise between coding quality and 
resource consumption. 

(ii) The independence of the optimum input noise am- 
plitude <7° pt from signal amplitude makes the integrate- 
and-fire neuron a useful signal processing device, as no 
fine-tuning of the noise to the signal is required to at- 
tain optimal performance. The noise level need only be 
adjusted relative to the DC offset, which largely reflects 
homogeneous background activity. The optimum noise 
amplitude of cr° pt w 0.6 — 0.7 (relative to the threshold 
distance 1 — fi) is in good agreement with the observation 
that coincidence detection in the auditory system of barn 
owls works best for sub-threshold stimuli which raise the 
average membrane potential to roughly one noise ampli- 



tude below threshold |15|. 

Property (iii) is the central finding reported here: a 
model neuron as simple as the integrate-and-fire neu- 
ron may switch between two distinct modes of opera- 
tion, a transmission and a selection mode. Switching be- 
tween the two modes is achieved by variation of the tem- 
porally homogeneous background input to the neuron: 
weak background activity activates the selection mode, 
a strong background the transmission mode. Switching 
between modes requires only moderate variations of the 
background activity as indicated by Fig. ||(b). In the 
former, an input signal of particular frequency reaching 
the neuron through synapses far from the cell body — and 
thus the spike generator — may easily be (de-)selected: 
modulatory input through synapses closer to the spike 
generator need only vary the amplitude q of the net in- 
put current I(t) to the spike generator to tune the neu- 
ron's optimum frequency fi opt either closer to or away 
from the given signal frequency fi. Selected signals are 
then coded into spike trains with high signal-to-noise ra- 
tio, i.e., trains with clear temporal structure, while de- 



selected signals elicit more random output. Since pulse 
packets can propagate through networks of neurons only 
if they are sufficiently strong and tight plj , variation of 
the SNR provides a means of gating such packets through 
neuronal networks. 



V. SUMMARY 

We have shown here that the filter properties of a 
threshold system exploiting stochastic resonance in the 
sub-threshold regime are linearly related to the AC am- 
plitude of the input signal, and may be tuned by vari- 
ation of the DC signal amplitude. Our results indicate 
that such a simple device may, with the aid of noise, pro- 
vide the means to selectively transmit signals in neuronal 
networks. It might thus harness noise for the benefit of 
neuronal computation. Although our study is set in the 
framework of neurons as the most widespread threshold 
detectors in nature, the results apply more generally to 
any threshold system that may be characterized as an 
Ornstein-Uhlenbeck escape process. 

We would like to thank A. N. Burkitt, G. T. Einevoll 
and W. Gerstner for critically reading an earlier version 
of the manuscript. 
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FIG. 2. (a) Optimal signal-to-noise ratio and (b) optimum 
noise amplitude as functions of the input amplitude. Squares 
and solid lines mark DC offset fi = 0.6, diamonds/dashed 
fi — 0.667 and circles/dotted \i = 0.889; reset potential is 
v r = 0, yielding relative resets of 7 = 1.5, 2, and 8. Lines are 
to guide the eye. 
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FIG. 3. (a) Optimum signal frequency as function of the 
input amplitude for relative resets 7 — 1.5 (solid), 7 = 2 
(dashed) and 7 = 8 (dash-dotted). Lines are least-squares 
fits, while symbols mark different (fi, w r )-combinations yield- 
ing the same 7: circles stand for v r = and crosses for 
v r = 0.7, with fi from Eq. (^). (b) Slope of the least-squares 
fits of the frequency-amplitude relation shown in (a) as func- 
tion of the relative reset 7. The solid line is an empirical fit 
AQ opt /Aq r = 0.65 - 0.23 arctan[7.0(7 - 2.1)]. 
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